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'some  simple  theoretical  examples  of  time  series  in  m  dimensions,  their  main 
properties,  estimation,  and  forecasting  are  given.  These  are  generalizations 
of  the  usual  time  series  to  events  in  both  time  and  space.  How  these  models 
may  be  simulated  is  explained.  One  Practical  example  of  flooding  on  the 
Mohawk  River  is  given.  Included  are  new  results  in  forecasting;  the  regions 
for  permissible  values  of  the  autocorrelation  and  cross  correlations;  and 
methods  for  obtaining  these  correlations.^ 

1.  INTRODUCTION 

The  purpose  of  this  paper  is  to  give  a  short  introduction  to  the  main  ideas 
of  time  series  in  m  dimensions.  These  simple  examples  are  concerned  with 
results  in  only  one  dimension.  Full  generality  to  m  dimensions  is  given  in 
the  papers  of  Aroian  and  his  collaborators.  The  usual  time  series  is  in  tero 
dimensions.  The  same  methods  apply  to  purely  spatial  series  if  time  is  not  a 
consideration;  spatial  series  are  explored  in  a  forthcoming  paper  of  Aroian 
and  Gebizlioglu  (1) .  Every  event  occurs  in  time  and  space.  An  event  has 
many  characteristics;  only  the  univariate  case  is  treated  here.  For  the 
multivariate  case,  see  Aroian  (2).  As  examples,  if  m  *  1,  note  the  charac¬ 
teristics  of  a  river,  and  as  a  generalization  any  process  involving  a  flow. 

If  m  *  2,  examples  are  physical  processes  as  a  storm,  rainfall  over  a  region, 
the  changing  physical  or  social  processes  over  time  in  a  restricted  region: 
for  m  «  3,  examples  are  the  positions  of  satellites,  sunspots  on  the  sun, 
geological  processes  and  earthquakes,  storms  in  space,  or  characteristics 
over  an  U,,t2,t,,t)  coordinate  system.  Social,  industrial,  scientific, 
geophysical  a5  well  as  other  processes  may  be  explained  by  these  models. 

2 .  ARJ1A  MODEL 

The  autoregressive  moving  average  model,  m  ■  1,  is  defined  for  m  »  1,  r.  «  r, 
-  2  by:  12 

zx,t  =  ’tlzx,t-l+lf2zx-l  t-l”eiax,t~l_e2ax-l  t-l+ax  t  (2.1) 

The  characteristic  z  t  in  which  one  is  interested  is  given  as  a  linear 
combination  of  two  pait  values  of  z  at  (x,t-l)  and  <x-l,t-l),  r,  «  2;  and  two 

past  values  of  a  variable  a  . ,  a  .  ,,  random  shocks,  with  an  error 

ax  t,  ^  -  2.  We  assume  zxx'"s  weSEiy^stationary ,  E(zx  t)  -  0  (with  no  loss 

generality),  E(zf  -.l-ofo,  E(zv  z„  „  )=ofc>  „  f  —  <  x  <«.,-«<  t  <  »; 
«  A/tj  y » 15  *  *  y 

a  ..  is  an  independent  random  variable  with  mean  zero,  variance  E(z  z  ) 

E (a  ,a  .  .  )  »  0,  unless  l  ■  k  -  0,  when  it  is  o':  and  a_  .  is  independent 

Aft  A  Aft  A  ft  Aft 


0,  then 


zx,t  *  ax.t-elax,t-l-Vx-l.t-l 
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(2.2) 


is  a  moving  average  MA  model  m^  •  1 ,  ■  2;  if6j»82*0 

ax,t  *  Vx,t-l+*22x-l,t-l+ax,t 

is  an  autoregressive  AR  model  m  ■  1,  rj  *  2. 

If  the  t  variable  is  omitted  and  if  in  Equation  (2.1)  one  replaces  x  and  x-1 
on  the  right  hand  side  by  x-1  and  x-2  except  in  a  t  one  gets  a  purely 
spatial  model;  while  if  the  x  variable  is  omitted? 'one  gets  the  usual  time 
series.  A  simpler  ARMA  model  is  obtained  if  one  sets  ■  6,  ■  0,  or 
«  e,  «  0.  The  MA  model,  the  AR  model,  and  the  ARMA  modelAwith  their 
properties  will  be  considered. 

3.  PROPERTIES  OF  THE  MA  MODEL 


The  autocorrelation  function  of  the  MA  model ,  the  values  which  6.  and  6^  may 
have,  and  the  corresponding  AR  model  with  an  infinite  set  of  coefficients 
will  be  given.  From  Voss  et  al.  (3),  the  variance 

a2  «  o2(l+e?+e^)  (3.a) 

z  a  i  l 


nnd  the  correlations 

o01(1+8l+e2l  ”  _61'  p10(1+6l+62)  *  6ie2’ 

°ll<1+ei+e2)  “  “®2 '  <3. 2) 


all  other  autocorrelations  are  zero.  Note  ■  p-l-l'°01  ”  c0-l'  P10  “p-10’ 


This  curtoff  property  of  the  autocorrelation  function  aids  in  the  identifica¬ 
tion  of  an  MA  model  m  *  1,  r,  »  2.  A  corresponding  cutoff  property  is  true 
for  any  MA  model,  {m,r).  Rewrite  (2.2)  as 


x,t 


‘^iVWt'Vt 


(3.3) 


where 


Bta*,t 


“ 


Bxax,t 


a*-i,t'  and  1_eiV 


e2BxBt  is  called  the 


“x,t-l' 

generating  function  or  characteristic  polynomial  of  the  MA  model 
(3.3)  as 


Rewrite 


x.t 


'<1-eiBt-«2BxV 


-1. 


«.t"{j!o 


(81+  62Bx! 


j^2x,f 


(3.4) 


This  is  an  infinite  AR  model  representation  of  (2.2)  provided  |8  |+|P,|<1, 
since  |BXI<1,  |Btl<l  for  convergence  of  (3.4).  Every  HA  processes 

stationary  but  for  a  representation  as  an  infinite  AR  model,  the  condition 
1 6^  |  + 1 | <1  is  necessary.  Note  the  coefficients  of  rx_j  t_)t  approach  zero 

as  f,k  ■»  ~.  These  results  may  also  be  obtained  by  successive  substitutions 
in  (2.2),  or  by  straightforward  division.  From  (3.2)  we  infer 

l+6l+e2“  -Vp01  ’  6lVp10  "  -62/pll  '  (3' 


ei  ■  -pio/oii'  ®2  *  -pio/eor  ei  ’  (e2poi,/oir 
.  .  -°ir0iit1-«<°o1+P2n)ll/2 

e  «  - 5 - 2 - 

2  (p01+£>ll^ 

Hence  1-<<Poi+pii)  *  °>  or  poi+pll  *  3/4> 

a  circle  of  radius  1/2.  From  -  *p10/,®01’  we  conclu<3e  pio 
|81!  ♦  | e 2 | < 1 ,  the  added  restrictions  apply: 

-l/c10  <  l/ou  +  l/o01  <  1/P10  °‘p10  *  1’  or 


(3.6) 

(3.7) 


.A 


-p0162- 


(3.8)  /  ,  AvA  V'vV 
/  *r>  0 

A  A,  -  >  <:'- 


Frorfi''.  *<(?.  'A  v..- 

>  \  c  i 
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X  t*  \ 
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A-  \ 

'  v'* 


1/^0  <  l/on  *  l/p01  <  -1/P10  if  -1  <  <-10  i  o  .  (3.9 

Thus  the  only  values  of  (p..  1 ' 0 10 *c  11  *  P°Bsible  are  those  in  the  intersection 
of  (3.8)  and  (3.9).  1 


In  summary,  given  8j  and  $2  then  pQ1,  c10,  and  may  be  found  from  (3.2). 

If  a  representation  of  (2.2)  as  an  infinite  AS  model  (3.4)  is  desired,  then 
|e1l+|e2l<l  and  the  coefficients  of  this  AR  model  are  given  by  (3.4). 

Additionally  *0oi ' °10' B11 '  (3.6),  (3.7),  (3.8),  and  (3.9). 

Conversely,  given  P01 > P10 ’°11 '  which  define  *n  ***  process  (2.2),  then  if 

(3.4)  is  satisfied,  all  equations  (3.5),  (3.6),  (3.7),  and  (3.8)  are 
satisfied.  Note  pQ1  and  p^  must  satisfy  (3.7)  and  consequently  c1Q  * 

-e2P01.  Hence,  given  tP0l'°ll''  e10  iB  determined.  If  an  arbitrary  set 


I  P 


01' 


=10,cll^  are  ^rom  BOme  unknown  time  series  in  m  dimensions  the  equations 


(3.5),  (3.6),  (3.7),  (3.8),  and  |$11+|62I<1  will  not  be  satisfied.  For 
instance,  let  6^  =  .2,  62  •  -.5,  o|  =  1.29c^,  Pg2  *  -.1550,  p^q  m  -.0775, 
c..  «  .3876.  All  equations  (3. 5-3. 9)  are  satisfied.  The  corresponding  AR 
miAel  is  ax  t  -  *X(t  +  - 2*x,t-r- 5zx-l ,  t-i+ '  0<lx  ,  t-2*  ‘  2zx-l ,  t-2  +  ‘ 25**-2  ,  t-2 

+  -008zx,t-3'-06Vl,t-3+-152x-2,t-3-'125V3,t-3+---etC-  SuPP°”  frOW  “ 
simulation  of  this  process  the  sample  values  are  r«,  *  -.19,  r20  •  -.10,  r21 
*  .40,  to  determine  the  estimated  values  of  the  constants  8, ,8  three 
equations  must  be  satisfied,  an  impossibility.  Instead  iterations  are  used 
in  order  to  satisfy  the  (3.5)  as  closely  as  possible.  The  result  is  8^.22, 

e2  «  -.55,  l+e2+e2  «  1.3509,  and  resulting  r's  from  (3.5)  are  rni  *  -.163, 
r!0  *  -090'  rll 


-  1.3509,  and  resulting  r‘s  from  (3.5)  are  rQ1 
.407. 


We  rewrite 
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o 
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4.  SIMULATION  OF  THE  MA  MODEL 
Given  (8j,62),  |82|+|8j|<1,  simulate 


z 


x,t 


*x,t‘8l*x,t"82ax- 


l,t-l 


(4.1) 


by  first  generating  a  Bet  of  random  numbers  (axJ^  t+j' '  *“0,1,2,...,  r+4,j«0, 
1,2,. ..,s*4,  from  a  distribution  u-0  ,o-l  .This  gives  (r+5)(s+5)  values  of  ®x+i  t+j 

random  numbers.  Then  from  these  values  of  a's  calculate  (r+5) (s+5)  values  of 
(rx+i  t+j)  with  the  chosen  theoretical  set  using  (4.1).  All  a’s  not 

generated  as  above  are  identically  zero.  Delete  the  first  two  rows,  first 
two  columns,  the  last  three  rows  and  the  last  three  columns  of  the  Z  matrix. 
This  produces  a  reduced  Z  matrix  of  rs  value.  Note  the  number  five  is  chosen 
for  convenience,  so  an  inner  Z  matrix  may  represent  the  process  properly.  In 
the  example  8j«.2,  62— .5,  and  the  ax  t's  are  normally  distributed  with  v-0, 

oa«l,  r*s-10,  zx  is  given  as  the  first  number  in  each  cell  of  Table  1.  The 
a  .,  the  second  number  in  each  cell  of  Table  1  is  not  the  10X10  inner  part 
of  15X15  original  Z  but  is  determined  from  the  10X10  Z  matrix  by  using 


x,t 


zx,t  + 


8lax,t-l+82ax-l,t-l' 


(4.2) 


are  taken  as  zero  lor 


with  8j-.2,  8j— .5  where  now  ax  t_j  and  «x_1  t_j 
initial  starting  values.  Thus  in  the  first  row  ax  t*zx  t-  In  the  first 

column  all  unknown  a's  for  x<l  are  zero.  In  this  way  a  set  of  a's  are  built 

up  slightiv  different  from  the  inner  10X10  a  ’a  obtainable  from  the  15X15 

original  Z  matrix.  This  is  done  since  in  a  sample  of  zx  t  the  ax  t  must  be 

determined  in  this  way  (although  in  practice  the  would  be  unknown  and 

would  be  a  set  estimated  from  the  sample  zx  t's).  in  the  second  row 

all  needed  a's  are  known  as  soon  as  the  first  a  it  determined,  and  subse¬ 
quently  for  each  row,  since  the  needed  a's  in  any  cell  are  found  by  uaing  the 
zx  t  in  that  cell  and  the  ax  t_j  in  the  cell  directly  above  and  the  a)(_1 

in  the  cell  one  to  the  left  and  above  using  (4.2).  fhi|  set  of  a’s  is  used 
in  finding  all  further  Z's  for  all  subsequent  sets  (8., 6,).  From  the  10X10 
_  ^  * 

Z  matrix  determine  r_  z  (the  sample  mean),  c  (the  sample  variance  of  z, 
m ,  n  2 

r01’  r10‘  rn •  u*4ng  (3. 5-3. 7)  iteratively  at  in  3.  New  estimates 

z  .  may  be  found  using  any  desired  (8., 8.)  particularly  a  set  satisfying 
13.5-3.7)  and  having  a  minimum  prediction  error  variance  o'  -  lf(rx  t_i£x  t' 

/(n-1).  This  is  essentially .a  least  squares  procedure.  The  minimum  variance 
procedure  is  to  vary  a  set  (8,  ,8.)  in  the  plane  such  that  o2  is  a  minimum. 

2  1  *  c 
The  theoretical  value  of  oc  is 

°c  “  °a  *  (8l"®l,2+<82““2)2) 

where  0^  and  8^  are  population  values.  This  method  is  remarkably  effective, 

working  well  for  autoregressive  models  also  (3).  Note  zlx.t),  are  values 
from  the  minimum  prediction  error  variance  set  §1-.208,82»-. 493  almost 

identical  to  the  theoretical  set  (.2, -.5)!;  while  z(x,t),  are  from  {.  333-.4181 
the  least  squares  set  most  nearly  satisfying  (3.5)— (3. 7>f  which  leads  to  a 
theoretical  ^°oi'°10 ,011*  *et  ot  • 259 • 108 • • 325 >  compared  with  an  actual 

*r10'r01'rll'  of  {-• 255, -.133,  .299)  from  zx  t<  The  values  of  r^  n  in  Table 

2  are  those  from  z  .(the  notation  of  z(x,t)  in  Table  1  is  used  for  conven- 
X » c 

ience.)  Further  from  (5*1)  in  the  next  section  given  (.2, -.5),  the  95% 
confidence  interval  for  8^  is  (.036, .364)  and  for  8^  is  (-.664 ,-. 336)  and 

{  .333, -.418)  cuts  these  limits. 


5.  ESTIMATION 


The  variances  and  covariances  of  (tj.fj)  are  approximated  by  use  of  the  sample 
estimates  r01>  r1Q,  r^inasample  of  n  of  poi'Djo'Dn  and  the  relationship 
of  the  variance-covariance  matrix  of  MA  models  which  are  the  same  as  those  of 
AR  models.  From  the  results  of  Perry  and  Aroian  (4), 


n“1(l-rJ0)"1(l-eJ-82-28J82r10) ,  and 


(5.1) 


These  correspond  to  the  least  squares  solution  of  the  corresponding  AR  model 

and  if  the  a  are  assumed  to  be  distributed  normally,  these  are  close 
x ,  r 

approximations  to  the  maximum  likelihood  estimates  of  (See  Box  and 

Jenkins,  (5)  p.  283,  for  similar  case,  m»0.)  The  starting  values  of  *x  t  as 

noted  in  the  simulation  would  need  to  be  considered  for  the  maximum  likeli¬ 
hood  solution.  The  method  leading  to  (5.1)  is  general  (nd. applies  to  the  m 
dimensional  nA  model.  The  minimum  variance  estimates  *nd  the  result¬ 

ing  estimates  of  the  correlation  between  and  «2  may  be  found  as  noted  in 
the  next  section  lor  any  set  of  data. 


TABLE  1 

Values  of  Z(x,t),  s(x,t),  Z(x,t)j,  Z(x,t)2 


t  x _ _ 

z (x,t) 

.  f(x.t) 

*<*'*>1 
Zix.%) 2 

z  (x,t 
2  a (x,t) 

*«»•«, 
Z(X,t)  - 


2 _ 3 _ 4 _ 5 

0.815  -0.301  0.337  -1.277 

0.815  -0.301  0.337  -1.277 

0.815  -0.301  0.337  -1.277 

0.815  -0.301  0.337  -1.277 


7 _ 6 _ 9 

0.210  -0.625  0.867 

0.210  -0.625  0.067 

0.210  -0.625  0.867 

0.210  -0.625  0.867 

0.132  1.506  -1.602 

-0.090  1.276  -1.116 

0.127  1.510  -1.605 

0.061  1.572  -1.666 


z (x,t) 
a  <  x ,  t ) 

z(x,t) 

Z (x,t)2 

-0.105 

-0.386 

-0.094 

0.082 

-1.199 

-0.598 

-1.165 

-1.016 

-0.701 

-0.232 

-0.706 

-0.802 

-0.649 

-1.116 

-0.659 

-0.783 

1.620 

1.228 

1.626 

1.739 

0.425 

1.175 

0.425 

0.384 

0.148 

-0.364 

0.142 

0.079 

-0.124 

0.176 

-0.134 

-0.266 

0.595 

-0.266 

0.595 

0.639 

-0.060 

0.196 

-0.040 

0.232 

z(x,t) 

0.450 

-0.484 

-1.375 

-0.278 

-1.252 

0.540 

-0.343 

0.767 

-2.043 

-0.903 

0.  372 

-0.411 

-1.123 

-0.365 

-0.448 

0.162 

-1.003 

0.904 

-2.184 

-0.731 

z (x,t) . 

0.453 

-0.477 

-1.369 

-0.267 

-1.254 

0.522 

-0.348 

0.768 

-2.042 

-0.903 

z  ( x ,  t )  2 

0.501 

-0.373 

-1.295 

-0.110 

-1.324 

0.283 

-0.391 

0.773 

-2.022 

-0.907 

z(x,t) 
a(x,t) 
z (x, t) . 
z  ( x ,  t )  2 
z(x,t) 

*(X,t> 

l  (x#t) . 

* (x,t) 


*<x,t)  0.297  -1.163  2.8 
zU,t)J  0.277  -1.434  2.8 

z (x,t)  -1 . 572  1 .603  -0.6 
#(x,t)  -1.506  1.277  0.0 
*(x,t)  -1.575  1.607  -0.6 
z (x #  t ) 2  -1.616  1.683  -0.8 

MEAN  OF  z(x,t)  -  -0.0757732 
MEAN  OF  a (x,t)  -  -0.0620963 
MEAN  OF  £(X,t)x  -  -0.0745114 


0.840  -0.364 

1.128  -1.063 

1.241  -1.111 

-0.648  0.602 

-1.050  0.109 

-0.674  0.599 

-0.984  0.501 

-0.742  0 . 557 
-0.015  1.503 

-0.723  0.569 

-0.447  0.694 

0.124  -2. 361 

-0.029  -1.653 
0.131  -2.367 

0.234  -2.494 

-1.601  -0.279 

-1.244  -0.596 

-1.596  -0.266 

-1.536  -0.057 

-1.140  -0.279 

-0.466  0.224 

-1.117  -0.266 

-0.823  -0.098 


VAR.  OF  Z(x,t)  -  1.29559 
VAR.  OF  a(x,t)  •  1.03742 
VAR.  OF  z(x,t)1  -  1.29484 


The  prediction  error  variance  of  z(x,t),  •  .00009444634 
For  z(x,t)1#  §A  -  .208,  02  •  -.493 


MEAN  OF  z(x,t). 


VAR.  OF  z(x,t). 


The  prediction  error  variance  of  z(x,t>2  »  .0245026 


For  z (x, t) 2 ,  -  .333,  e2  -  -.418 

Mhere  z(x,t).  is  the  prediction  with  mininun  error  without  regard  to  (3-5)  to  (3-8) 
z (x, t) 2  is  the  prediction  with  minimum  error  with  grgsrd  to  (3-5)  to  (3-8). 


TABLE  2 


ESTIMATED 


CORRELATION  COEFFICIENTS 
rm,n  from  *x.t 


m  n  0 

-=s — -.osn?r 

-4  -.00683 

-3  .00744 

-2  -.04944 

-1  -.13263 

0  1.0000 

1  -.13263 

2  -.04944 

3  .00744 

4  -.00683 

5  -.02440 


1  2  3  4  5 


-.06929 

-.01955 

-.21941 

-.02406 

.15886 

-.25518 

.29921 

.05475 

-.00829 

-.08132 

.00370 


77TT5T 

-.15060 

-.09758 

.09758 

-.05186 

.10146 

.03112 

.02902 

-.04685 

.06358 

-.06670 


‘  7553TT 
.12190 
-.16610 
.02137 
.07963 
.01626 
-.13549 
.05822 
.12587 
-.00833 
-.05665 


-.07173- 

-.06967 

.14620 

.03338 

-.08132 

-.05956 

.03900 

-.10431 

.01059 

.07500 

.05308 


,oii99"" 

.06822 

.06586 

.00839 

.03068 

.02659 

-.12965 

.04176 

.00946 

-.04081 

.01927 


6.  PROPERTIES  OF  THE  AR  MODEL 
The  properties  of  the  AR  model 


x,t 


l*x  t — 1^*^X^ X— 1  ( t — 1  ^^x .  t 


(6.1) 


are  taken  from  Taneja  and  Aroian  (6)  and  Perry  and  Aroian  (4).  These  are: 
the  characteristic  function, 


«<W  -  l-<VWBt: 

the  autocorrelation  function, 

o  ■  a.  o  _  +  A_o  ,  .  ,  m  =  n  0 ; 

tn,n  V1  m,n-l  y2  m-l,n-l 

the  variance, 

°*  '  Oa(1-»lcor*2cll>‘1: 
and  the  stationarity  condition 


I  ♦  I*  I  <1» 

the  Yule-Walker  equations. 


U01 


U11 


Vl0+*2 


with  the  solutions 

A  WAX' 

-c„,p 


(t,ors10p10)  a*p10rl 


<Pll"P01P10)  a‘pio’ 


Since  >  0,  then  f<>oi '°10 '  P11  *  are  **#tricted  by 
°10+p01*pll"2p01p10pll"1<a  • 


(6.2) 


(6.3) 


(6.4) 


(6.5) 


(6.6) 


(6.7) 


(6,8) 


If  (6.8)  is  set  equal  to  tero,  then  for  each  value  of  e,.  (6.8)  represents  an 
ellipse.  The  permissible  values  lie  within  the  rectangle  described  in  the 
ellipses.  The  rectangle  is  bounded  by 


-1+P10<P01~P11<1™P10 ' 


and 


*1‘P10<P01+P11<1+P10  •  ,6-9 

While  an  AR  model  is  invertible,  it  is  not  stationary  unless  condition  (6.9) 
is  satisfied.  Note  that  given  a  permissible  set  of  * P10 ,pll ' P01 *  th*n  «nd 

»2  are  determined  by  (6.7).  However,  if  Uj.fj)  *r*  given,  then  •  <°oi  * 


are  unique  and  may  be  determined  from  the  corresponding  AM  model  of  the  AR 
model.  An  example,  the  depths  of  the  Mohawk  River,  discussed  briefly  in  the 
Perry  and  Aroian  paper  (4)  is  being  expanded  from  three  points  on  the  river 
to  ten  points.  The  results  will  be  used  to  predict  floods  along  the  Mohawk. 
Let  4^  *  .2,  4j  ■  -.6,  p^q  »  -.20671,  p^  •  .32523,  p^  »  -.64174.  The 

simulation  of  this  set  of  {p10, Pgi ,(111  ^  *ccon'Pli*hed  by  using  the  4’s  and 


any  set  of  starting  values  with  the  a's  generated  by  any  desired  distribution. 

The  values  of  p  for  this  example  are  given  in  the  table  for  (m,n)  in  the 
m  ,n 


first  and  second  quadrants;  the  results  in  the  third  quadrant  are  the  same  as 
those  in  the  first  quadrant,  while  the  results  in  the  fourth  quadrant  are  the 

same  as  those  in  the  second  quadrant.  Thus  P_„*P_  „ ,  P„  _  »  c  _ 

m,n  _ft , — n  ro.-n  -m,n 

but  p  f  p  _  .  This  follows  from  the  defini- 

“In ,  n 


m,  0 
tion  of  p 


p-m,0'  °0,-n  *  p0,n' 


x*y 'ti -t- 


given  in  section  2.  A  table  of  the  correlation  p 


for 


^1  “  ^2  *  *s  Presented* 


TABLE  3 

CORRELATIONS  p  IN  AR  MODEL 
ft  »  n 


*1 

«  .2 

*2  ‘ 

-.6 

n 

m 

0 

1 

2 

3 

4 

5 

6 

7 

6 

8 

.01 

.03 

7 

-.01 

-.04 

to 

o 

1 

6 

.01 

.02 

.07 

.09 

.07 

5 

-.01 

-.04 

-.11 

-.12 

-.09 

-.05 

4 

.01 

.02 

.06 

.17 

.17 

.11 

.06 

.03 

3 

-.01 

-.03 

-.09 

-.26 

-.22 

-.12 

-.06 

<N 

O 

1 

-.01 

2 

.04 

.13 

.41 

.28 

.13 

.05 

.02 

.01 

1 

-.21 

-.64 

-.32 

-.13 

-.05 

-.05 

-.02 

-.01 

0 

1.00 

.33 

.11 

.03 

.01 

-1 

-.21 

-.07 

-.02 

1 

o 
*— 1 

-2 

.04 

.01 

-3 

-.01 

The  numbers  in  the  blank  spaces  are  zero. 

Every  AR  model  has  a  cutoff  property  given  by  the  partial  autocorrelation 
function,  4A  in  this  case;  4^  f  0  for  i  ”  1,2;  4^  »  0,  i  f  1,2,  where  4^  is 

determined  by  the  Yule-Walker  equations  corresponding  to  AR  models,  r  >  2. 
For  an  m  «  1  model  is  of  order  one  if  4 j ,  4^ , . . . ,4r ,  are  zero  as  determined 

by  the  partial  coefficient  of  correlation,  Taneja  and  Aroian  (6). 


The  approximate  estimated  variances  and  covariances  of  (4j,42>  given  by 


'rJ0)-1(l-4j-4*-2* 


1"2  r10* 


and 


(6.10) 


\'i2  *  rio 

are  approximate  maximum  likelihood  results,  if  the  a  t's  are  distributed 
normally,  are  asymptotically  unbiased,  consistent,  and^minimum  variance.  Let 


V(»1(»2)  -  n‘1(l-r1*)  R*1  -  n*1U-r01*1-r11i2)  Rj1  ' 

where  V(»1,$2>  i»  the  variance-covariance  matrix  of  (ij.tj).  The  minimum 
variances  of  ( i x >  may  be  found  numerically  by  varying  (ij.tj)  the 

variance  o2  is  minimized  for  the  particular  sample. 

The  AR  model  may  be  given  as  an  infinite  AM  model 

zx  t  *  "  f  l,'i'iax-i  t-i' 

*’t  i-0  i-0  13  X  3 

♦oo’1-  *0l"4l'  W  *02"*r  *12“2*1*2'  *22"#2 *  (6-U) 

^0 j"^1^0 j-1 '  •ij-*l*i.J-l+*2*i-l.J-l,  *Jj“Vj-l.j-l  ' 

like  (4.1)  replacing  by  and  6^  by 

For  «x-.2,  ♦oo’1*  4’0l“'2'  "'ll*"-6'  *02*-04' 

*12—  .24,  *22-.16,  U.u3-.008,  *13—  .072,  *23».216, 
i|/33«.216,  etc. 

An  AR  model  simulation  is  given  in  Perry  and  Aroian  (4). 

7 .  ARMA  MODELS 

The  results  of  Oprian  et  al.  (7)  are  used  freely  in  addition  to  some  new 
results  mainly  in  the  determination  of  values  of  {$3 , »2 ,63 , e2 )  as  related  to 

the  values  of  (®oi ' p10  '  C11 ' P-1  1*‘  The  results  are: 
o2  -  o2{i-e1(41-e1)-e2(42-82)}!i-«.1D01-»2r10)'1  . 

°01  “  Wl0'6l°a/oz!  6l°a/0z  '  WlO^Ol  (7>1) 

°11  ‘  *lp10+Ve2ca/oz!  Va/0z  “  Vl0+Vell 

°10  *  4lDl-l+<>2D0l"e2  (4l_ei,0a/0z  ’ 

2  2 

The  second  and  third  equations  may  be  solved  for  ej0a/°I  and  these  results 
substituted  in  the  first  and  fourth  equations  to  obtain  t 4^ , *2 , 6^ , } .  If 
43"|>2»0,  or  Bj-Oj-O,  the  corresponding  MA  or  AR  models  are  obtained.  For 
m,n  >  2, 


°m,n  “  4lcm,n-l+42pm-l,n-l 

The  ARMA  model  may  be  represented  as  an  infinite  moving  MA  model 


?  f*4aa 


i-0  j-0 


ij"x-i,t-J' 


an  infinite  AR  model 

?  fVx.it-1-  (7-4) 

i-0  j-0  13  x  1,1  3 

restrictions  already  noted  |«3I+|*2I<1  and  |8j|+|62I<1,  naturally  restricting 
the  values  of  (0oi'p10'pll'  also.  The  infinite  MA  model  is  given  by 


S3 


-1. 


*x,t  ■  ,1-6lV62BxBt>  '‘-‘iWA1  «*,t- 

(1-6lV92BxBt'  ‘.^‘VW^t'  ax,t‘ 


(7.5) 


with  *00-l.  *01-V61<  H’n'VV  ^02*^1 ' 


^"♦l  V2V2_*2rl .  ’’0j"Tl’’0,j-I' 

Similarly  the  ARMA  model  as  an  AR  model : 

T  _  _ 

00 


r*l'  "11  _  82_^2*  "02  ”  ei(ei“*l> 


(7.6) 


"l2  *  _fcl*2  +  26ie2_fl2tl'  ”22  *  92  <92"<'2)' 


(7.7) 


*0j  *  Vo,j-l>  ’ij  '  Vi.j-l+Vi-l,j-l' 
rii  *  Vi-i.i-i  • 

Note  (3.10)  and  (6.11)  are  special  cases  of  (7.5)  and  (7.6).  For 
t,  *  .2,  ♦,  »  -.6,  *  .2,  62  =  -.5, 


*00 


1,  «  -.1,  *12  *  --oi'  *22  *  -.6.  *13  •  -.004, 


(7.8) 


«23  «  .024,  *  -.036,  etc. 


The  autocorrelation  function  must  be  found  by  using  (7.5)  and 

t>  n  «  C14.,,*,  „  .  >  (m2  t"1,  m  *  n  y  0 

m,n  13  r-m,]-n  13 


(7.9) 


and 


Thus  c2/02  »  1.01741,  obtained  from  (7.9)  and  (7.10),  must  be  used  in  (7.1) 
to  solve  for  i -gi ' P10 'cll ' pl-l ^  “  ( . 058 ,-.091 ,- . 127 ,- . 213 )  as  compared  to  the 

MA  model  (-.155, -.078, .389,0),  and  the  AR  model  ( . 33 ,-. 21 ,-.64 ,- . 07 ) .  In 
fact,  had  4^  *  .2,  4j  -  -.6,  6j  ■  .2,  8^  -  -.6,  been  chosen,  then  the  ARMA 

model  would  have  been  reduced  to  (1-.2B  +.6B_B  )z  “(1-.2B  +.6B  B  )a  ,  or 
zx  t«a  t!  Conversely,  had  a  sample  set  of  s*/s*,  ^ roi ,r10 ,rll ’ rl-l ^  keen 
given,  estimates  , *2 '®1  '®2*  could  ^e  found  from  (7.1)  as  already  given  by 

substituting  the  sample  estimates  for  the  population  values.  These  results 
with  the  exception  of  (7.1)  and  the  methods  of  solution  given  there  are  due 
to  Robert  Perry  in  his  ongoing  Ph.D.  thesis. 

How  may  the  estimates  of  (4 2 ,42 , 8^ , 8j )  in  a  sample  of  n  be  found?  One  method 
is  to  choose  the  set  ($2 ,$2 , § j , §2 )  which  minimizes  s2  ,  the  sample  estimates 

of  a2  as  done  in  4  by  varying  the  four  constants  numerically.  The  other 
method  is  to  find  the  corresponding  AR  model  through  and  then  apply  the 
method  given  in  section  5. 

8 .  FORECASTING 

Now  that  the  models  have  been  defined,  their  properties  given,  it  is  necessary 
to  show  how  these  results  may  be  used  for  forecasting.  It  should  be  realized 
that  in  forecasting  it  is  not  necessary  to  assume  the  future  repeats  the  past. 
All  that  is  needed  is  to  assume  that  the  errors  of  the  past  will  be  repeated 
in  the  future,  although  the  events  themselves  will  not  necessarily  be 


formula*  must  not  be  used  blindly,  but  must  be  checked  carefully. 
In  the  MA  case  (2.1)  : 

i,  L  J  .  ,  .  *  a  ,.  .  .  g  "8.  B  .  j  .  .  .  1  “  0 x  *  1  .  .  J  , 


x+fj.t+fj  “  “x+fj.t+fj  ■elax+«i,t+£2-l‘e2ax+t1-l,t+t2-l 
'x+t^t+lj  '  ax+t1,t+l2_9lax+£1  ,t+l2-l*62ax+l1,t+t2-l 


Vt'W 

-  0 

^<£i-V  ' 

2  2  2 
V1+6l*e2>  ' 

(8.13) 

■  ij  2  2  or 

>  2.  The  other 

cases  are 

Vt'0'1’  ' 

-6lax,t~62ax-l,t* 

*x,tU'0)  “  'e2ax,t-l 

Vt10'11  - 

ax,t+l'  ex,t(1,0! 

‘  ax+l,t”9lax+l,t-l 

(8.14) 

Vt11'11  * 

'e2ax,f  ex,tll,1) 

“  •x-i,t-r®iax*i,t 

and  of  (0 . 1 )  -  0?,  o*(l,0)  -  (1  +  6?),  of(l.l)  *  o*U+6*> 

C  8  S  8  1c  AX 


The  more  general  ARMA  model  is  changed  to  infinite  MA  model  given  in  (7.5), 
and  terms  as  far  as  carried  for  accuracy.  The  method  is  exactly  the 

same.  The  models  may  be  updated  as  new  results  are  obtained. 


Forecasts  and  forecast  errors  are  correlated.  In  any  MA  model  (and  by 
extension  any  AR  model  or  ARMA  model)  the  forecast  errors  are. 

Vt'0'1’  *  ax,t+i'  ex,ta-°>  ■  VW'iVi.fi  - 

and 

ex,t(1,1)  *  ax+l,t+l"9lax+l,t  . 


d<e„it  (0.1)  ,  ext(l,0))  «  p!(.  (0,1),  ex  t  (1,1)}  -  0, 

2  -1  <8.1 
C(ex  t(l,0),  eXit(l,l))  —  Sjd+ej)  1 

Correlations  among  other  forecast  errors  may  be  found.  Forecasts  are  also 
correlated.  From  (8.H) 


c{*x,t<0,1>'*x,t<1'0))  ”  o,*x,t(1,0) '*x.t<l'1,)  *  °> 


o,2x,t(0,1) '*x,t(1'l) }  ■  6 1 1 -1/2  .  (8.11 

The  autocorrelation  function  for  forecasts  and  forecast  errors  may  be  found 
in  a  similar  manner. 


It  has  been  assumed  in  the  foregoing  that  all  constants  8.  are  exact  where  in 
fact  estimates  of  6^  are  used,  including  the  sample  mean  1  .  A  discus¬ 

sion  of  this  matter  is  given  in  Box  and  Jenkins  (5) ,  pages  267-268.  For  the 
mean,  an  additional  source  of  variation,  the  c£/n  is  added  to  the  formula 
2  a 
for  c2  given  in  (8.10)  and  is  important  if  n  is  fairly  small,  n  i  100, 

depending  on  the  model.  For  the  power  spectra  of  the  discussed  models,  see 
the  papers  of  Voss  et  al.  (3),  Taneja  and  Aroian  (6),  and  Oprian  et  al. 
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